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Response to Amendment 

1 . The amendment was received on February 8, 2005. Claims 1 -1 2 are pending. 

Drawings 

2. Due to the amendment, the objection to figure 5 is withdrawn. 

Response to Arguments 

3. Applicant's arguments filed 2/8/2005, page 5 to 6 have been fully considered but 
they are not persuasive. 

4. Page 5 and 6 of the remarks states, "Altunbasak neither teaches nor fairly 
suggests the Applicant's recited second and third means (and corresponding method 
steps)." 

However, Altunbasak does teach the Applicant's recited second and third means 
(and corresponding method steps) as indicated in the office action for claims 1,3,5,7,9 
and 11, below. In general, refer to col. 13, line 59, which discloses a "hybrid system" in 
col. 13, line 59 that "alternates" in col. 13, line 59 between "motion parameters" in col. 
13, lines 60,61 and a "lens-distortion parameter" in col. 13, line 62. In other words, 
"motion parameters" in col. 13, lines 60,61 or the claimed geometric transform factors 
can be solved using a hybrid system based on coordinates, Xgy g , x' g , y' g of equation 42, 
then the hybrid system modifies equation 42 that is an equation of the above mentioned 
coordinates to "estimate" in col. 13, line 62 a lens-distortion parameter, K7, in col. 13, 
line 66 or the claimed lens distortion factor based on the claimed geometric transform 
factors also referred to as "affine parameters [that are] clamped" in col. 13, lines 66,67. 
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Alternatively, a lens distortion parameter, Kzor a linear "lens-distortion parameter" 
in col. 14, line, 30, which corresponds to the claimed lens distortion factor, is 
"recovered]" in col. 14, line 30 during "Linearization in Geometric Correction" in col. 14, 
line 1 with respect to the nonlinear K7 or "lens distortion parameter" in col. 13, line 62 of 
the method of "Nonlinear Geometric Correction" in col. 13, line 25. Thus, K 7 or a linear 
"lens-distortion parameter" in col. 14, line, 30 during "Linearization in Geometric 
Correction" in col. 14, line 1 or the claimed third means is based on a second means 
"Nonlinear Geometric Correction" in col. 13, line 25 which in turn is based on the claim 
first means as shown in figure 2. 

Claim Rejections - 35 USC § 102 

5. The following is a quotation of the appropriate paragraphs of 35 U.S.C. 102 that 
form the basis for the rejections under this section made in this Office action: 

A person shall be entitled to a patent unless - 

(b) the invention was patented or described in a printed publication in this or a foreign country or in public 
use or on sale in this country, more than one year prior to the date of application for patent in the United 
States. 

6. Claims 1-12 are rejected under 35 U.S.C. 102(b) as being anticipated by 
Altunbasak et al. (US Patent 6,597,816 B1). 

Regarding claim 1, Altunbasak et al. discloses in a lens distortion factor 
calculating apparatus and method for subjecting an image picked up by image pick-up 
means having a lens to lens distortion correction, the lens distortion factor calculating 
apparatus comprises: 
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a) first means (Equations 33 and 34 in column 1 1 which is illustrated in fig. 2 
as vertical arrows.) for finding, on the basis of two images (fig. 2, numerals 220 and 
240) picked up by the image pick-up means (fig. 1, num. 1 10 is an image capture 
device in col. 2, line 39.), the coordinates of a plurality of corresponding points (A point 
in image 220 is in the upper left corner and a point in image 240 is in the lower right 
corner, which corresponds to coordinates (Xg, y g ) and (x,y) of equations 33 and 34, is 
picked up by the image pick-up means of fig. 1,num. 1 10 where the*points of images 
220 and 240 is a plurality of corresponding points because the point of image 240 is the 
same point of image 220.) between the images (fig. 2, numerals 220 and 240); 
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b) second means ("[A]ffine model" in col. 12, line 63 is a second means that 
is applied "subsequently]" in col. 12, line 64 to equations 33 and 34 as mentioned from 
col. 12, line 62 to col. 13, line 25 and illustrated in fig. 2 as horizontal arrows to derive 
equation 41 of column 13.) for calculating ("[A]ffine model" in col. 12, line 63 is a second 
means that is applied "subsequently]" in col. 12, line 64 to equations 33 and 34 as 
mentioned from col. 12, line 62 to col. 13, line 25 and illustrated in fig. 2 as horizontal 
arrows to derive equation 41 of column 13 that is used for calculating,...), on the basis 
of the coordinates ("[AJffine model in coK 12, line 63 is a second means that is applied 
"subsequently]" in col. 12, line 64 to equations 33 and 34 as mentioned from col. 12, 
line 62 to col. 13, line 25 and illustrated in fig. 2 as horizontal arrows to derive equation 
41 of column 13 that is used for calculating on the basis of coordinates, (Xg, y g ) and (x,y) 
of equations 33 and 34.) of the corresponding points ("[A]ffine model" in col. 12, line 63 
is a second means that is applied "subsequently]" in col. 12, line 64 to equations 33 
and 34 as mentioned from col. 12, line 62 to col. 13, line 25 and illustrated in fig. 2 as 
horizontal arrows to derive equation 41 of column 13 that is used for calculating, on the 
basis of coordinates, (x g , y g ) and (x,y) of equations 33 and 34, which represent 
corresponding points as mentioned in col. 11, lines 40-46.)... 
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... found by the first means ("[A]ffine model" in col. 12, line 63 is a second means that is 
applied "subsequently]" in col. 12, line 64 to equations 33 and 34 as mentioned from 
col. 12, line 62 to col. 13, line 25 and illustrated in fig. 2 as horizontal arrows to derive 
equation 41 of column 13 that is used for calculating on the basis of coordinates, (Xg, y g ) 
and (x,y) of equations 33 and 34, which represent corresponding points as mentioned in 
col. 1 1 , lines 40-46 found by the first means or equations 33 and 34 in column 1 1 which 
is illustrated in fig. 2 as a vertical arrow that map between coordinates of 
distorted/corrected coordinates ,(Xg, y g ) and (x,y), respectively in col. 11, lines 65-67.),... 
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...geometric transform factors ( (1 [A]ffine model" in col. 12, line 63 is a second means that 
is applied "subsequently]" in col. 12, line 64 to equations 33 and 34 as mentioned from 
col. 12, line 62 to col. 13, line 25 and illustrated in fig. 2 as horizontal arrows to derive 
equation 41 of column 13 that is used for calculating, on the basis of coordinates, (Xg, y g ) 
and (x,y) of equations 33 and 34, which represent corresponding points as mentioned in 
col. 1 1 , lines 40-46, found by the first means or equations 33 and 34 in column 1 1 which 
is illustrated in fig. 2 as a vertical arrow that map between coordinates of 
distorted/corrected coordinates, (Xg, y g ) and (x,y), respectively in col. 11, lines 65-67, 
geometric transform factors, (Xg, y g ) and (x' g ,y' g ) in equation 41 of column 13 where (Xg, 
y g ) is a "distorted pixel position[ ]" in col. 1 1 , lines 64,65 in the images 220 and 240 of 
figure 2 that correspond with images of 210 and 230, respectively, and (x' g , y' g ) is the 
"distorted pixel position[ ]" in col. 11, lines 64,65 denoted by the subscript "g" with 
"velocity components" in col. 3, lines 29,30 denoted with superscript " ' " where (Xg, y g ) 
and (x^, y'g) corresponds with "undistorted" in col. 11, line 41 images of fig. 210 and 
230, respectively, and mentioned col. 11, lines 40-45 and 65-67.) between said two 
images (fig. 2, numerals 220 and 240); and 
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c) third means for calculating (Equation 42: <+Ms a third means that is derived 
from the first means, equations 33 and 34 and second means, equation 41 for 
calculating,.... ), on the basis of coordinates of the corresponding points found by the 
first means (Equation 42: W is a third means that is derived from the first means, 
equations 33 and 34 and second means, equation 41 for calculating, on the basis of 
coordinates, (Xg, y g ) and (x,y) of equations 33 and 34, which represent corresponding 
points as mentioned in col. 11, lines 40-46 found by the first means or equations 33 and 
34 in column 1 1 which is illustrated in fig. 2 as a vertical arrow that map between 
coordinates of distorted/corrected coordinates ,(Xg, y g ) and (x,y), respectively in col. 11, 
lines 65-67.) and the geometric transform factors (Equation 42: ^ is a third means that 
is derived from the first means, equations 33 and 34 and second means, equation 41 for 
calculating, on the basis of coordinates, (Xg, y g ) and (x,y) of equations 33 and 34, which 
represent corresponding points as mentioned in col. 1 1 , lines 40-46 found by the first 
means or equations 33 and 34 in column 1 1 which is illustrated in fig. 2 as a vertical 
arrow that map between coordinates of distorted/corrected coordinates ,(Xg, y g ) and 
(x,y), respectively in col. 11, lines 65-67 and geometric transform factors ,(Xg, y g ) and 
(x' g ,y' g ).) found by the second means (Affine motion model in col. 12, lines 62-64),... 
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... a lens distortion factor(Equation 42: V is a third means that is derived from the first 
means, equations 33 and 34 and second means, equation 41 for calculating, on the 
basis of coordinates,(Xg, y g ) and (x,y) of equations 33 and 34, which represent 
corresponding points as mentioned in col. 1 1 , lines 40-46 found by the first means or 
equations 33 and 34 in column 1 1 which is illustrated in fig. 2 as a vertical arrow that 
map between coordinates of distorted/corrected coordinates ,(Xg, y g ) and (x,y), 
respectively in col. 11, lines 65-67 and geometric transform factors ,(Xg, y g ) and (x' g y g ) 
found by the second means, a lens distortion factor,"K 7 " in col.1 1 , line 65 and col. 13, 
line 66 that is "estimatefd]" in col. 13, line 62 using the equation 42: "4*" of column 13 
where equation 42 is derived from equation 41 or second means that generated the 
claimed transform factors (Xg, y g ) and (x' g y g ) which in turn is derived from equation 33 
and 34 or the first means that generated the claimed coordinates (Xg, y g ) and (x,y) of 
equations 33 and 34.) 

Regarding claim 2, Altunbasak et al. discloses the lens distortion factor 
calculating apparatus according to claim 1 , characterized in that the first means 
comprises: 

a) means ("motion estimation" models from col. 1 , line 67 to col. 2, line 3.) 
for extracting ("recognized" in col. 2, line 1) an overlapped portion ("successive 
overlapping images" in col. 1, lines 64,65) of the two images (fig. 2, numerals 210 and 
230 are successive overlapping images.) picked up by the image pick-up means (fig. 1, 
num. 1 10 is an image capture device in col. 2, line 39.), 



Application/Control Number: 09/988,630 Page 10 

Art Unit: 2621 

b) means for extracting, from the overlapped portion ("successive 
overlapping images" in col. 1, lines 64,65) of one of the images (fig. 2, num. 210) with 
the other image (fig. 2, num. 230), a plurality of partial images ("small rectangular 
regions" in col. 13, line 43) effective for tracking (Using optical flow a trajectory of a pixel 
is followed as mentioned in col. 2, lines 52,53. The small rectangular regions 
correspond to Xg, which is a "OFE [optical flow equation]... equation" as mentioned in col. 
1 1 , lines 54-64.) by an optical flow (Section: "Optical flow" in col. 2, line 51 has an OFE 
equation 10 located in column 4.) between both the images (Fig. 2, numerals 210 and 
230 which correspond to equation 10 with two images li and b.) as feature points 
(rectangular "regions with features" as mentioned in col. 13, lines 41-47), and 
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c) means for tracking a point (A "motion vector" is used for each pixel in col. 
2, lines 22-26 and col. 5, lines 10,1 1 .), which corresponds (The motion vector is used 
for mapping pixels from one frame to another in col. 12, lines 62-63. Note that a motion 
vector is generated in an affine motion model which represents a vector as a set of 
parameters and pixel location as mentioned in col. 5, lines 13-15 and col. 6, lines 
48,49.) to each of the feature points (The affine motion model is used with the 
rectangular "regions with features" as mentioned in col. 13, lines 41-53.) on the one 
image (fig. 2, num. 210), on the other image (fig. 2, num. 230) on the basis of the optical 
flow (The affine motion model represents a motion vector is based on optical flow 
equation. The equation at the bottom of column 6 is based on equation 9 in column 3 
which is an optical flow equation described in the section of "Optical flow" from col. 2, 
line 51 to col. 4, line 67.) between both the images (Equations 38 and 39 in column 13 is 
a mapping from one frame to another frame as mentioned in col. 13, lines 19,20 
Additionally, fig. 2 shows the mapping from one frame to another.). 

Claim 3 was addressed in claim 1. 

Claims 4,6,8,10 and 12 were addressed in claim 2. 

Claim 5 is similar to claim 1 except for the limitation of a computer readable 
recording medium (fig. 1, num. 130) having a lens distortion factor calculation program 
(fig. 1, num. 130 has "instructions" in col. 2, lines 40,41.) which is disclosed by 
Altunbasak et al. 
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Claim 7 is similar to claim 1 except for the additional limitations of a means and 
method: 

d) fourth means ("A hybrid system" in col. 13, line 59 is a fourth means.) for 
subjecting the first image (fig. 2, num. 220) and the second image (fig. 2, num. 240) to 
lens distortion correction ("A hybrid system" in col. 13, line 37 is a fourth means for 
subjecting the first image 220 and second image 240 to lens distortion correction or 
"Nonlinear Geometric Correction" in col. 13, line 25) on the basis of the lens distortion 
factor ("A hybrid system" in col. 13, line 59 is a fourth means for subjecting the first 
image 220 and second image 240 to lens distortion correction or "Nonlinear Geometric 
Correction" in col. 13, line 25 on the basis of K7 which is the claimed lens distortion 
factor; equation 42 or that is a function of lens-distortion k 7 in col. 11, line 65 and 
col. 13, lines 34,35.) calculated by the third means ("A hybrid system" in col. 13, line 59 
is a fourth means for subjecting the first image 220 and second image 240 to lens 
distortion correction or "Nonlinear Geometric Correction" in col. 13, line 25 on the basis 
of K7 which is the claimed lens distortion factor, K7 in col. 1 1 , line 65 and col. 1 3, lines 
34,35,66 in equation 42 or tty V" in col. 13, line 65 that is a function of lens-distortion, 
calculated by the third means or equation 42: ^ or a{ ¥" in col. 13, line 65 modified with a 
"one-dimensional optimization technique" in col. 13, lines 61,62.); and 
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e) fifth means (Fig. 3 is a fifth means.) for combining (Fig. 3 is a fifth means 
that corresponds to "Motion estimate techniques" in col. 1 , line 63 for combining or to 
"stitch together" in col. 1 , line 54.) the first image (fig. 2, num. 220) and the second 
image (fig. 2, num. 240), which have been subjected to the lens distortion correction 
("Nonlinear Geometric Correction" in col. 13, line 25), obtained by the fourth means ("A 
hybrid system" in col. 13, line 59) using the geometric transform factors ((Xg, y g ) and 
(x'g.y'g) in equation 41 of column 13) between the first image (fig. 2, num. 220) and the 
second image (fig. 2, num. 240) which have been subjected to the lens distortion 
correction ("Nonlinear Geometric Correction" in col. 13, line 25). 

Claim 9 was addressed in claim 7. 

Claim 1 1 was addressed in claims 5 and 7. 

Conclusion 

7. THIS ACTION IS MADE FINAL. Applicant is reminded of the extension of time 
policy as set forth in 37 CFR 1.136(a). 

A shortened statutory period for reply to this final action is set to expire THREE 
MONTHS from the mailing date of this action. In the event a first reply is filed within 
TWO MONTHS of the mailing date of this final action and the advisory action is not 
mailed until after the end of the THREE-MONTH shortened statutory period, then the 
shortened statutory period will expire on the date the advisory action is mailed, and any 
extension fee pursuant to 37 CFR 1 .136(a) will be calculated from the mailing date of 
the advisory action. In no event, however, will the statutory period for reply expire later 
than SIX MONTHS from the mailing date of this final action. 
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8. Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to Dennis Rosario whose telephone number is (571 ) 272- 
7397. The examiner can normally be reached on 6-3. 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Joseph Mancuso can be reached on (571) 272-7695. The fax phone 
number for the organization where this application or proceeding is assigned is 703- 
872-9306. 

Information regarding the status of an application may be obtained from the 
Patent Application Information Retrieval (PAIR) system. Status information for 
published applications may be obtained from either Private PAIR or Public PAIR. 
Status information for unpublished applications is available through Private PAIR only. 
For more information about the PAIR system, see http://pair-direct.uspto.gov. Should 
you have questions on access to the Private PAIR system, contact the Electronic 
Business Center (EBC) at 866-217-9197 (toll-free). 

Dennis Rosario 
Unit 2621 



